Golang Job: Data Engineer

About Us

We are a dynamic, rapidly growing global company and the innovators of service-driven supply chain planning software. For more than two decades, we’ve been helping companies around the world overcome demand volatility and supply chain complexity so they can deliver outstanding service to their customers and bottom line.

Our solutions have been recognized by customers globally and analyst firms, such as Gartner, for our ability to support service and inventory trade-offs, while dramatically improving planner productivity. ToolsGroup has been successfully deployed worldwide in more than 44 countries, and we have one of the highest customer retention rates in our industry.

About the Role

ToolsGroup is looking for a Data Engineer to join our Technology team. We are looking for an individual who has strong data modelling, scripting and pipelining skills. A Data Engineer must be able to work with large complex data sets, connect multiple systems in the most secure and efficient way. In this role, he/she will be responsible for designing, documenting, developing, unit testing, and supporting data pipelines between ToolsGroup applications having the possibility to leverage state of the art technologies and tools.

Main Responsibilities

• Design reliable and scalable ETL/ELT pipelines right from ingestion of the data to the delivery of the end product
• Build custom solutions to automate workflows and supporting architecture
• Understand business logic, allowing you and other team members to make informed decisions about design changes and improvements
• Take ownership of existing products and pipelines, making sure they are delivered on time
• Implement upgrades and optimizations to existing processes, including migration of the code to newer versions of libraries/packages/infrastructure/etc.
• Communicate with different stakeholders to set expectations and figure out priorities
• Ensure quality, reliability and uptime for critical automated processes, including helping the data science team diagnose and resolve issues in the pipeline and in the data
• Design environments within the Toolsgroup platform to house the data in a secure manner and enabling clients and internal teams to access it appropriately.

Requirements

• A Bachelor's Degree in Engineering, Information Technology, or similar field
• At least 3 years of commercial experience programming in languages typically employed in AI/ML such a Python, Java, Scala, GoLang or R
• At least 2 years experience working with distributed systems such as Hadoop, Spark in cloud computing platforms such as AWS, GCP and Azure (AWS Glue, Databrick, Azure Data Factory)
• At least 1 year of experience maintaining a client-facing data pipeline in a production environment
• Experience with both structured and unstructured databases, SQL, No-SQL, Relational Databases, Datalakes and Lakehouses
• Knowledge of engineering best practices
• DataLake and DataLakeHouses

Aptitudes

• Good understanding of Data Engineering, NoSQL databases and database design, distributed systems and/or information retrieval
• Knowledge of Apache Airflow
• Familiarity with common Azure services
• Experience writing high-performance queries in SQL and unstructured or graph query languages
• Experience with SaaS highly distributed systems, distributed cloud storage, event queues and data streaming using Apache Kafka.
• Ability to plan and collect requirements for projects, and interact with the analyst and data science teams.

Benefits

• Base salary range depending on experience and skills.
• 15% performance bonus
• 401K with employer match
• Paid time-off
• Medical, Dental, Vision insurance

Why Join ToolsGroup?

Become part of the supply chain planning disruption joining the fast-growing ToolsGroup family!

Our people are the engine that propels ToolsGroup to innovate - pushing the boundaries of what's possible. You’ll be surrounded by the very best and brightest, rewarded with competitive compensation, and career growth opportunities; becoming part of a company where teamwork and collaboration are paramount.

Are you ready to take this exciting opportunity and develop your professional career within a growing company?

Then, send us your application today and join our team!